REGULARITY AT THE BOUNDARY AND 
TANGENTIAL REGULARITY 



TRAN VU KHANH AND GIUSEPPE ZAMPIERI 



Abstract. For a pseudoconvex domain D c C", we prove the 
equivalence of the local hypoellipticity of the system (8,3*) with 
the system (d b ,d£) induced in the boundary. This develops our 
former result in [5] which used the theory of the "harmonic" ex- 
tension by Kohn. This technique is inadequate for the purpose 
of the present paper and must be replaced by the "holomorphic" 
extension introduced by the authors in [6]. 



Let D be a pseudoconvex domain of C n defined by r < with 
C°° boundary bD. We use the standard notations □ = dd* + d*d 
for the complex Laplacian and Q{u,u) = \\du\\ 2 + ||9*w|| 2 for the 
energy form and some variants as, for an operator Op, Qo p (u,u) = 
||Opc?M|| 2 + | |Op<9*w| | 2 . Here u is a antiholomorphic form of degree 
k < n — 1 belonging to Dq* . We similarly define the tangential version 
of these objects, that is, D b , B b , 8%, Qq p - We take local coordinates 
(x, r) in C n with x G IR 2 ™ -1 being the tangential coordinates and r, the 
equation of bD, serving as the last coordinate. We define the tangential 
s-Sobolev norm by |||m||| s := ||A s u||o where A s is the standard tangen- 
tial pseudodifferential operator with symbol A| = (1 + |£| 2 ) 5 . We note 
that 

'||5u||2 + ||^ti||2 = EQA-^(«»«). 
X1) * |||^||| 2 + |||a^||| 2 tQ AS ( u , u ), 

\\d b u b \\ 2 s + \ \d;u b \\ 2 s = Q b Aa {u b ,u b ). 
We decompose u in tangential and normal component, that is 

u = u + u , 

and further decompose in microlocal components (cf. [8]) 

u T = u T+ + u T - + u t0 . 

We similarly decompose u b = + + u b . We use the notation L n 

for the "normal" (0, l)-vector field and L\, ...,L n _i for the tangential 
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ones. We have therefore the description for the totally real tangential, 
resp. normal, vector field T, resp d r \ 




From this, we get back L n = \(d r + iT). We denote by a the symbol of 
a (pseudo) differential operator and by u the partial tangential Fourier 
transform of u. We define a "holomorphic" extension u T+( - H ^ by 

(1.2) u T+{H) = (27r)- 2n+1 / e^e r<T(T V + (O^(^0)de 

This definition has been introduced in [6]. Note that cr(T) > (1 + |£| 2 )^ 

for £ in supp ip + and (x, r) in a local patch; thus in the integral, the 

exponential is dominated by e~' r K 1+ ^' 2 ) 2 for r < 0. Differently from 
the harmonic extension by Kohn, the present one is well defined only 
in positive microlocalization. We can think of 

U r+{H) j n 

two different 

ways: either as a modification of u T+ or as an extension of u b . We 
have a first relation from [8] p. 241, between a trace v b and a general 
extension v. for any e and suitable c e 

(1.3) || v b \ \ < c e 111^111 1 + e|||9 r w||| i. 



2 111 1 1 1 2 



This can been seen in [8] p. 241 and [6 J as for the small/large constant 
argument. As a specific property of our extension we have the reciprocal 
relation to ( 11. 3D . that is 

(1.4) \\r k u T+{H) \ \ < 



\'H \\-k- 



This is readily checked ( [6 J (1.12)). We denote by d T the extension of df, 
from bVt to Q which stays tangential to the level surfaces r = const. It 
acts on tangential forms u T and its action is d T u T = (du T ) T . We denote 
by d T * its adjoint; thus d T *u T = d*(u T ). We use the notations T and 
Q T for the corresponding Laplacian and energy form. We notice that 

(L5) =Q r {u r+ W t u r+ W) m 

We have to describe how (11. 3ft and ( ll.4p are affected by d and d*. 

Proposition 1.1. We have for any extension v of Vb 

(1.6) Q b (v b , v b ) < Q T r(v, v) + Q T l (v, v), 

f-vj A ^ Or A * 
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and, specifically for u t+(kH ' > 
(1.7) 

Proof. We have 



L„^+W = 0. 



<9 t ^|&d = d b v b , d T *v\ bD = d* b v b . 

Then, (jl.6p follows from (jl.3p . 

We pass to prove ( 11. 7ft . We have d 1 " = 9& + rTan, <9 r * = d£ + rTan 
which yields 



'1. 



£T u T+(ff) = (9 6M6 )r+W + rTan 



Application of ( 11. 4ft yields 

||^r+(H)||2 + ||gr. w r+(fl)||2 = 1 1 (g^r+W 1 12 + 1 1 (S^+W 1 12 + || rTan? 

<ii^<ir_ 1 +ii5 6 vii 2 _ 1 +i| M +ii 2 _ i! 

~ 2 2 2 

which is the first of ( 11. 7ft . The second is an easy consequence of the 
relation L n = \{d r + iT). 

□ 

We finally decompose u T+ = u T+ ( H ^ + u T+( - ^ which also serves as a 
definition of u T+( -°\ 

Proposition 1.2. Each of the forms = u v , u T ~, u r0 , u T+( -°\ , u® 
enjoys elliptic estimates, that is 

(1.9) \\(u#\\ s < ||C'^ # || s -i + ||C'a*« # || a -i + ||^ # ||o s > 2. 
Proof. Estimate ( II. 9p follows, by iteration, from 

(1.10) \\(u#\\ s < ||C^ # || s _i + ||C^ # l| s -i + \\Cu*\\s-i- 

As for u u and u T+ ^ this latter follows from u u \ b £> = and u T+( -°' > \ b o = 0. 
For the terms with — and 0, this follows from the fact that < |tr(9)| 

in the region of 0-mico localization and from o~[d, 8*] < and cr(T) < 
in the negative microlocalization. We refer to [2] formula (1) of Main 
theorem as a general reference but also give an outline of the proof. We 
start from 

(l.n) |||C« # lll?<Q(C« # ,C« # ) + IIC'« # llo; 

this is the basic estimate for u v and u T+ ^ (which vanish at bD) 
whereas it is [8] Lemma 8.6 for u T ~, u T and u^, u b . Applying (11.111) 
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to £A s-1 (/u# one gets the estimate of tangential norms for any s, that 
is, fll.lOp with the usual norm replaced by the "triplet" norm. Finally, 
by non-characteristicity of (d, d*) one passes from tangential to full 
norms along the guidelines of [12] Theorem 1.9.7. The version of this 
argument for □ can be found in [8] second part of p. 245. 

□ 



Let C an d C' be a couple of cut-off with ( -< £' in the sense that 
C'lsuppC = 1) and let s and / be a pair of indices. 

Theorem 1.3. The following two estimates are equivalent: 
(1.12) 

\\Cu h \\, < \\('d b u b \\ s+ i + \\('d* b u b \\ s+l + | Hlo for any u b e C™(bQ n V), 
(1.13) 

HC^IU < \\C'du\\ s+l + \\('8*u\\ s+l + \\u\\ for any u G Dq* fl C™(Q n U). 

Remark 1.4. The above estimates (11.121) and (I1.13P for any s, (, £' 
and for suitable /, characterize the local hypoellipticity of the system 
(8 b , &l) and (8, 8*) respectively (cf. [9]). When / > 0, one says that the 
system has a "loss" of / derivatives; when I < 0, one says that it has a 
"gain" of —I derivatives. 

Proof. Because of Proposition II .21 it suffices to prove (11.121) for and 
(11 . 13)) for u T + . It is also obviuos that we can consider cut-off functions £ 
and £' in the only tangential coordinates, not in r. We start by proving 
that (11.12)) implies (11.131) . We recall the decomposition u T+ = u T+ ^ + 
u T+ ^ and begin by estimating u T+ ( H \ We have 

(1.14) 

melius < \\c<\\U 

^ 2 

< Q b AS+l ^ ( M> u t) + \KW-± 

(OS) 
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It remains to estimate u T+ ^; since w r+ ^|f,_D = 0, then by 1-elliptic 
estimates 

(1.15) 

wc« T+(0) iii. < gA-cK +(0) ^ T+(0) ) + lllcv+(°)||iLi 

fTTot 

< Q A s- lc (u^,u^) + Q A - C (^ +( "V +W ) + HICV+WIH^ 

< Q As ^\u^) + \\\Cu^\\\* + |i|CV + W|||^ + Hicv^iii^, 

where we have used that Q = Q T over u T+ ^ in the second inequality 
together with the estimate Q\ a -i < A s in the third. We estimate terms 

in the last line. First, the term |||C wT+ ^|||s is estimated by means of 
f)1.14p . Next, the terms in (s — l)-norm can be brought to 0-norm by 
combined inductive use of (11 . 14j) and (11.151) and eventually their sum 
is controlled by ||w r+ ||o- We put together (11. 14j) and (11.151) (with the 
above further reductions), recall the first of (11.11) in order to estimate 
Q T A S (' + Qg rAs -i£, in the right of (jl,14p and end up with 

(1.16) \\\(u T+ \\\ s < \\Cdu T+ \\ a + \\£8*u T+ \\ s + \\u T+ \\ . 

Finally, by non-characteristicity of (8,8*) one passes from tangential 
to full norms in the left side of (jl.lfip along the guidelines of [12J The- 
orem 1.9.7. The version of this argument for □ can be found in [H] 
second part of p. 245. Thus we get (j!.13p . 

We prove the converse. Thanks to d r = L n + Tan and to the second 
of flUD, we have d r u T+{H) = Tanu T+{H \ It follows 

\\c<\\ 2 . < c e |iic^ +(H) iii; +l +6|iia r c^inLi 

lU~3t 



2 



< QI s+I+ 4,K +(if) ^ r+(ff) ) + ^IIIC^ +(ff) IHLi 



(1.17) ~ ^A s +'+ic' 

< Q b As + i c ,(u+,u+) + e\\(u+\\ 2 s . 
G2J 

We absorb the term with e and get ( I1.12p . 



□ 



Let N and G be the Neumann and Green operators, that is, the 
iJ°-inverse of □ in D and □& in bD respectively. 

Remark 1.5. (1 1 . 1 2 j) and (11.131) imply local regularity, but not exact s- 
Sobolev regularity, of G and N respectively. We first prove for N. We 
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start from remarking that 
(1-18) 



d*N is exactly regular over Ker<9, 
dN is exactly regular over Ker<9*. 



As for the first, we put u = d*Nf for / G Ker<9. We have (du = 
f, d*u = 0) and hence by ( Q3j) \\(u\\ s < \\( r f\\ s + \\u\\ . To prove 

the second, we have just to put u = dN f for / e Kerd* and reason 
likewise. It follows from ( 11.181) . that the Bergman projection B is also 
regular. (Notice that exact regularity is perhaps lost by taking the 
additional d in B := Id — d*Nd.) Finally, we exploit formula (5.36) in 
[TT] in unweighted norms, that is, for t — 0: 

N q = B q (N q 8)(Id - B q ^){d*N q )B q 

+ (Id - B q )(d*N q+1 )B q+1 (N q+1 d)(Id- B q ). 

Now, in the right side, the <9iV's and d*N y s are evaluated over Ker<9* 
and Ker 3 respectively; thus they are exactly regular. The B's are also 
regular and therefore such is N. This concludes the proof of the reg- 
ularity of N. The proof of the regularity of G is similar, apart from 
replacing f 1 1 . 1 9 j) by its version for the Green operator G stated in Sec- 
tion 5 of @] . 

□ 
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